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Abstract 


Analysis, the first phase of the typical instructional design process, is often downplayed. 
This paper focuses on the analysis concerning a series of e-courses for collaborative 
adult education in semi-formal settings by reporting and generalizing results from the 
Revit project. Revit, an EU-funded research project, offered custom e-courses to 
learners in several remote European areas and received a ‘best practice’ distinction in 
social inclusion. These e-courses were designed and developed for the purpose of 
providing training in aspects of the learners’ professional domains related to the 
utilization of information and communication technologies. The main challenge was to 
prove that it is possible and economically feasible to provide meaningful training 
opportunities via distance education, by utilizing existing infrastructure (“revitalizing 
schools”) and by making use of modern digital technology affordances coupled with 
suitable distance learning techniques and Web 2.0 tools. ADDIE, the generic 
instructional systems design model, enhanced with a rapid prototyping phase, was put 
forth in order to allow stakeholders to interact with a prototypical e-course, which 
served as an introductory lesson and as a reference point, since its evaluation informed 
the design choices of all subsequent e-courses. The learning needs approach adopted in 
Revit combined learner analysis, context analysis, and needs analysis into a coherent 
analysis framework in which several methods (observation, estimation, document 
analysis, survey, and dialogue) were exploited. Putting emphasis on the analysis phase 
and decoupling the design from the delivery of the e-courses facilitated adaptation and 
localization. Adaptation and localization issues concerning the adoption of the Revit 
distance learning framework, taking into account the socio-cultural and pedagogical 
context, are discussed. A central result reported is that the analysis phase was crucial for 
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the success of the whole endeavour and that carrying it out properly is not 
straightforward or easy. The analysis framework presented in this paper could be useful 
in other similar e-learning situations whose “educational-identity” also involves 
distance and adult learning in a semi-formal setting. 

Keywords: Distance education; adult learning; instructional design; analysis in e- 
learning; collaborative e-class 


Introduction 


Although analysis and evaluation are regarded as crucial phases in the instructional 
design process since “[they] concern the immediate needs of an organization” (Horton, 
2003, p. 25), they are often overlooked in e-learning projects (Shelton & Saltsman, 2011, 
p. 567; Rothwell & Kazanas, 2008; Wang & Wilcox, 2006; Trolley, 2006). Spending too 
little time in analysis is a mistake commonly made not only by inexperienced (Cook, 
2005), but also by expert instructional designers. Indeed, a research study (Visscher- 
Voerman & Gustafson, 2004) that investigated how expert instructional designers 
actually work with regard to the implication of the ADDIE model revealed that only 17% 
(4 out of 24) conducted a full analysis, while the others performed a limited one. 
Nevertheless, failing to fully explore the analysis phase in an e-learning project can 
bring about a negative impact on the relevancy and the quality of the educational 
endeavor (Shelton & Saltsman, 2011). The learning needs analysis is a key step of the 
instructional design process since the data gathered in this phase drive the nature of the 
intervention and its outputs inform the creation of learning objectives (Cook, 2005). It 
also has a significant impact in the continuous professional development of those 
receiving the training (Forbes et ah, 2006). A limited number of case studies exist in the 
recent literature, which refer to the analysis phase in educational contexts related to 
continuous professional development in non-credit lifelong learning. Examples include 
a survey of the information needs of rural and non-rural primary care physicians 
(Gorman, 2001) and a study that examines the training needs identified in adult rural 
communities (Frossard & Frutos, 2011). Yet, these examples do not incorporate the 
analysis as a phase of their instructional design model. 

The research question for Revit was: Can we provide attractive, meaningful, and 
relevant educational opportunities to adult professionals living in remote areas (in 
Europe) utilising existing infrastructures, Web 2.0 affordances, and available human 
resources in a way that is sustainable and economically feasible? Consequently, the 
purpose of the paper is to systematically explore a multifaceted analysis strategy to 
address instructional design in the context of a scalable and economically feasible 
example that provides lifelong learning opportunities to people who are usually 
excluded from mainstream educational activities, such as the inhabitants of remote 
areas. A central result reported here is that the initial analysis phase was crucial for the 
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success of the whole endeavour and that carrying it out properly is not straightforward 
or easy. 

The Revit project (REViTalizing Remote Schools for Life-Long Distance e-learning, 
http://revit.cti.gr . Lifelong Learning Programme/Transversal Programme/Key Activity 
3: ICT-European Commission, EACEA, January 2009 to December 2011) was addressed 
mainly to adults who were interested in receiving further training in aspects of their 
current or envisaged professional domain; usually those were aspects related to the 
utilization of information and communication technology. For this purpose, e-courses 
were designed and developed based on the actual needs of the specific remote 
application areas, as these were elicited from local people in Cyclades (Greece), 
Fornetka (Poland), Ullava (Finland), Kula (Bulgaria), and Palaichori (Cyprus). 

Figure 1 illustrates two points about the Revit project: 1) the geographical distribution 
of the application areas and 2) the fact that in each application area a dyad of project 
partners existed. The five dyads (the dyad of project partners shown in the map of 
Figure 1 in Italy is an exception) co-operated closely throughout the project duration 
towards the completion of the main project goal, that is to provide training via distance 
and online education in aspects of the learners’ professional domains related to the 
utilization of ICT. These dyads were comprised from one partner located in the 
application area (usually the municipality of the area), which liaised with the locals, and 
one partner in the same country, which liaised with the project consortium (this partner 
could be a university or a research center or an adult training center). 
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Figure 1. The Revit partnership. 

The Revit project placed a good deal of effort in conducting an extensive analysis and a 
comprehensive evaluation. The methodology and the results of the evaluation phase of 
the Revit project are available online (Dagdilelis, 2010) while this paper focuses on the 
analysis phase. Design, development, and implementation can be treated as a ‘black 
box’, since the combination of the pre-analysis and the post-evaluation confirms that 
the needs were met, given the actual commitment of the learners. 

Another similar endeavor that was running in parallel with the Revit project was the 
SoRuraLL! project (Rurall Social Networking for Lifelong Learning, 
http://www.sorura 11.c u) which investigated the potential for enhanced lifelong learning 
offered by social networking tools and platforms to those living in geographically and 
socio-economically disadvantaged rural areas. These projects exchanged ideas and 
experiences in domains of relevance (i.e., social applications for lifelong learning) in a 
set of conjoint events (meetings, conferences, etc.). 
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Research Method and Theory Used 


The Instructional Design Methodology Adopted in the Revit 
Project 

The many definitions of instructional design (ID) come from two different perspectives: 
a process or a discipline. Here the definition adopted is the following: “the entire 
process of analysis of learning needs and goals and the development of a delivery system 
to meet those needs. It includes development of instructional materials and activities; 
and tryout and evaluation of all instruction and learner activities” (Berger, 1996). 

As a process, ID mostly complies with the ADDIE model (Visscher-Voerman & 
Gustafson, 2004), an acronym for analysis-design-development-implementation- 
evaluation. Although the ADDIE model has received much criticism (Bruce, 2004; 
Colon et al., 2000), most of the instructional systems design (ISD) models are based 
upon it (Allen, 2006). Contradictory as this may seem at first, a satisfying explanation is 
given in Stolzer et al. (2011, p. 26): The criticisms for being too systematic (i.e., 
cumbersome, inflexible, linear) refer to the ADDIE model as originally proposed which 
resembled the waterfall model of software development (MacCormack et ah, 2003). 
Recently the model has evolved “into a more dynamic process in which the user can go 
back to the other phases as needed and revise steps as determined by the evaluation” 
(Stolzer et ah, 2011, p. 26). In Revit, ADDIE was enhanced with a rapid prototyping 
stage (Boulet, n.d) between design and development, as an extension of the design 
phase (Kruse, n.d). The model adopted in Revit is shown in Figure 2, where its two key 
elements (dynamic nature and rapid prototyping phase) are depicted. 
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Figure 2. The instructional design model adopted in Revit. Figure modified from 
Hodell (1994, P- 5 )- 


A central issue in instructional design is independence of phases, in particular from 
people involved. Each phase should be based exclusively on the output of the previous 
one and not depend on the same person being, for example, both designer and 
implementer. The several advantages of this independence come at the cost of process 
rigidity. Having the same person or team in several roles provides flexibility but hinders 
independence. In Revit we opted for a more flexible approach, in which people working 
in each stage of ADDIE were encouraged to liaise with persons in the previous and 
subsequent phases. Thus, persons carrying out the needs analysis were different from 
the course designers and from those delivering the course (tutors), but were available 
for interaction beyond formal documents. In this way and by adding a rapid prototyping 
phase for the first delivery of each course we were able to uphold a dynamic nature of 
the Revit instructional design model. 

A prototypical e-course (i.e., a series of lessons that constituted a course named 
“Introduction to Web Technologies”) was implemented and evaluated after the 
completion of the high-level design of the e-courses. The evaluation results were used to 
make corrective actions in the overall design and also informed the development of all 
subsequent e-courses. 
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The Revit Distance Learning Framework 

The Revit distance learning framework is shown in Figure 3. The picture of the school 
depicts a basic idea for the sustainability of this European research project: the 
exploitation of the existing infrastructure and human resources of schools in the remote 
areas. For the residents of these rural areas, their often small multigrade school plays an 
important role as a centre of culture and education for the whole community. Moreover, 
research work, for example Miller (1993), illustrates the important role of rural schools 
in their communities and the promising approach of collaborative partnerships between 
communities and schools for community revitalization and survival. The school acted as 
a central place in the Revit framework where the local moderators and the learners 
could get together during the delivery of the e-courses. The e-tutor, knowledgeable in 
the subject of the course, was the teacher delivering the e-courses at a distance. The 
local moderator was the person in charge of the learning process inside the classroom. 
This role was usually undertaken by one of the school teachers in the application areas. 
Their main duty was to foresee and solve problems that would threaten the learning 
process (like technology issues). A second level of national support for each 
participating country was provided by a university or a research organization. So 
learners were benefiting from four sources: the local moderator, the distant tutor 
(instructor), the subject matter expert (too expensive to be a tutor for a small audience), 
and the university partnership (that catered for the instructional design as a whole and 
provided the technological solutions). 

As an e-learning project whose “educational-identity” involves distance and adult 
learning, the Revit specifications and constraints were raised by an amalgam of 
knowledge about adult learning and distance education. Basic principles for adult 
learning (Rogers, 1996; Rogers, 2005; Jarvis, 2004; Knowles, 1990; Rosemary et al., 
2006; Schon, 1987) posit that adult learners are autonomous, self-directed, goal- 
oriented, and relevancy-oriented. Adults need to attain practical learning results that 
are forthcoming, tangible, and directly relevant to their own experiences and vocational 
or other aspirations. To create a learner-centered curriculum which is closely related to 
real-life situations and also close to the learners’ needs and aspirations, the instructional 
designer needs to know these needs and aspirations. Our aim was to foster community 
inquiry through “pragmatic technology” (Hickman, 1990; Bishop et al., 2009) with the 
concern to design a learning environment that meets actual learning needs, assesses 
knowledge in terms of its practical usage, and accommodates the learners’ lived 
situations. Moreover, there are different learning styles or characteristic ways in which 
adults prefer to learn (Rosemary et al., 2006) and in order to engage all learners, it is 
required to vary the methods in which information is communicated. 

The project involved a collection of e-courses that combined a variety of media, tools, 
and methods: 
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• synchronous distance learning sessions, with the use of a virtual classroom 
including use of e-whiteboard (“Elluminate live” was used as a webconference 
tool); 

• asynchronous learning sessions (Moodle was used as a learning management 
system); 

• Web 2.0 tools (podcasts, wikis, chat, forum, blogs) and a virtual world 
environment (namely “OpenSim”). 

On the other hand, Moore’s work on transactional distance acknowledges that the 
separation in time and space between students and their tutors may have a profound 
effect on learning and teaching in a distance education setting. This transactional 
distance can be defined as the gap of understanding and communication between the 
teachers and the learners caused by the spatiotemporal separation “that must be 
bridged through distinctive procedures in instructional design and the facilitation of 
interaction” (Moore & Kearsley, 2005, pp. 223-224). Towards this end, the Revit 
learning material was subjected to instructional design procedures that aimed at 
creating meaningful, practical, and relevant learning experiences. Also, the affordances 
of computer supported collaborative learning and e-learning 2.0 tools (mentioned 
above) were exploited in order to eliminate the transactional distance and to offer 
opportunities for dialogue and interaction. Social networking functionalities (Facebook, 
Twitter) were also incorporated in the Revit distance learning framework to establish 
and maintain ties with experts, e-tutors, instructors, learners, and other communities. 

Additionally, in alignment with the basic principles of learner-centered design - 
“understanding is the goal”, “motivation is the basis”, “diversity is the norm” (Soloway 
et al, 1994) - the topics of the courses were not predefined, but decided by the learners 
after constructive discussions with the instructional designers. An appropriate 
adjustment from what is academically valued in a knowledge domain to what is valued 
by the specific learners, while carefully examining learners’ characteristics, ensures that 
they will perceive content (rather its transformation into knowledge) as worth knowing 
(Sims, 2001; Parchoma, 2003). 

The e-courses included topics like “e-business”, “organic farming”, “rural tourism” and 
others. Eleven e-courses were offered in total, ten designed for adults and one for pupils. 
Each e-course lasted for a semester (10-13 weeks). 
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Figure 3. The Revit distance learning model. 


The Revit Learning Needs Analysis 

The design of a course starts from the educational objectives. They rely on a learning 
needs analysis, that is a set of activities for assembling information about the learners, 
their needs, wants, and the environment in which learning will take place. Based on the 
educational objectives, lesson plans, materials, tests, assignments, and activities are 
developed. The learning needs analysis clarifies the purposes of the educational 
program. 

Learner-centered and participatory models of instructional design emphasize learners’ 
characteristics - demographics, needs, preferences, and experiences, among others 
(Parchoma, 2003). Learning needs identification includes: 

• Learner analysis (Schwen, 1973; Chen, 2011, p. 94). Learner analysis identifies 
learner characteristics and individual differences that may have an impact on 
the learning process (Chen, 2011, p. 94). 

• Context analysis (Dick & Carrey, 1990; Tessmer, 1990). Context analysis is a 
systematic review of the settings in which instruction takes place and may 
involve parameters such as facilities, equipment, and so on. 

• Needs analysis (Rodriguez, 1998; Chen, 2011, p. 94). Needs analysis is used to 
determine the extent to which a learning need exists by conducting a needs 
assessment (Chen, 2011, p. 94). 
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The analysis conducted for Revit included investigation, elicitation, and commitment. 

Investigation was a feasibility study on the local technical and social space. For the 
technical space an investigation of the available facilities in the application area 
(Tessmer, 1990) was conducted for several parameters and factors involving the 
technical infrastructure (Internet connections with adequate bandwidth and available 
computers, cameras, and microphones in the support environment, i.e., the school and 
homes of participants). Another important factor for Revit was the adequacy, 
suitability, proximity, and availability in practice of the physical resources, mainly the 
school or community classrooms. 

For the social space, in order to clearly form the profile of the learners, a few visits in the 
application area were organized. Except for learners’ demographics and needs, in the 
context of adult learning in informal settings using distance education, elements like 
learners’ sociocultural context (Vygotsky, introduced by Tudge & Scrimsher, 2003), 
motivation (Jones & Davis, 2011; Bandura, 1978; Salomon, 1981; Gagne, Briggs, & 
Wager, 1992), and expectations from the educational program (Jones & Davis, 2011) 
were considered as highly important parameters and, consequently, informed the 
design decisions. Since planning instruction with the learner’s expectations and needs in 
mind always helps in achieving the learning objectives and being aware of the fact that 
the learners have high expectations from the use of technology in distant courses (Jones 
& Davis, 2011), this was something that needed to be reclaimed as an educational 
requirement. Motivation has been reported frequently (for example, McNair & 
Quintero, 2008; Marcinkiewicz, 2011) as a key success factor of learning with the use of 
ICT at a distance. Similarly, the learners’ sociocultural context plays an important role 
in distance education in general (Valcke & Leeuw, 1998), but also specifically in our case 
where the application areas were remote villages in five European countries. 

Geographical factors such as distances and accessibility always affect blended learning 
where students do whole physical meetings, albeit rarely. Relationships are always 
important and in small places more so. Availability varied daily (for teachers), weekly 
(in islands where the visiting boat schedule affects the life of the whole island), and 
yearly (for farmers). Local technical help (usually by a volunteer teacher, agronomist, or 
just a young person) can be a make or break factor at the beginning. 

Elicitation was the main stage of the needs analysis, in which learners were helped by 
the instructional designer to conduct a self-diagnosis regarding the learning tasks that 
might be most helpful to them. Here the instructional designer acted as a counselor who 
helps the students identify the knowledge and skills that are most beneficial to them 
(Brookfield, 2009). Informal communication was encouraged at this stage by the project 
team since it could convey valuable feedback concerning the learners’ attitudes towards 
the educational venture at stake. 

Elicitation involved a variety of interviewing and questioning techniques, like small 
group or public discussions, brainstorming (McDermott, 1982), and diagnostic 
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questionnaires in the form of online survey (Patterson, 2009) or in the traditional, 
written (offline) survey method, in order to obtain relevant performance data in topics 
of interest (Rorgiquez, 1990). Samples of the online questionnaire used in the Polish 
application area, as well as a sample of the questionnaire handed out in written form to 
the learners of the Bulgarian remote area, are shown in Appendix A. More details about 
the description of the methodology in each country concerning this stage are described 
in Appendix B. In practical terms, after a few visits in the application areas, the 
instructional designer team was able to estimate topics of common interest and the 
actual number of the participants in each of them. The method of informal discussion 
(“speaking their language”) proved helpful as a means of detecting educational needs in 
informal or semi-formal settings, as well as potential barriers. 

For Revit, taking into account the sociocultural context meant: 

• Courses were addressed to adult learners who may feel excluded from educational 
opportunities and also have a strong sense of belonging to the regional community. 
This created the pedagogical requirement of promoting collaborative learning in 
order to establish a sense of online learning community that would motivate the 
learners on the one hand and the expectation that the learners living in the same 
remote area would strongly affect each other’s opinion about the value of the 
program, on the other. 

• Some courses were attended by learners from multiple remote areas. Dealing with 
different languages constituted the main barrier in this case. Two ad hoc solutions 
were devised: Courses with learners from Palaichoni (Cyprus), Koufonisi and Ios 
islands (Greece) were offered in Greek; and courses on ‘English as a Foreign 
Language (EFL)’ were offered in English to learners from several countries. 

• Remote places are usually situated a long distance from metropolitan centers, are 
not densely populated, and are most commonly inhabited by older than younger 
people, who mainly practice “traditional professions” such as agriculture, fishery, 
and, in some cases, tourism. This has created the requirement that attracting 
learners’ interest would be related to the ways that ICT tools could help them 
practice their jobs better and the additional expectation that the learners probably 
wouldn’t have a clear vision about these ways. 

Receive learners ‘commitment of participation (Rodriguez, 1990). Our aim was to agree 
on a learning contract. In theory, a learning contract is "a formal, written agreement ... 
about what the learner will learn and how that learning will be measured" (Boak, 1998, 
p. 1). The use of learning contracts may foster the creation of online learning 
communities (Mahoney et al., 2000) and contribute to establishing trust and building a 
sense of community (Allan & Lawless, 2003). In Revit practice, the learning contract 
was a good presentation of the learning goals aiming at reaching consensus about them 
with the learners (10-20 learners in each remote area). In small communities, oral 
commitment expressed in public can be much more binding than private written 
commitment or even financial commitment. 
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Gaining the learners’ commitment is an important process in promoting among the 

learners the sense of greater responsibility and control of their learning. 

A prerequisite to asking the learners’ commitment was to discuss with them the 

following aspects: 

• The technological tools used throughout the e-courses. The intended use (purpose: 
tuition/ communication/else, and mode: synchronous/asynchronous) of each tool 
was explained to the learners, avoiding technical terminology. If possible, the 
person (usually the instructional designer) who conducted the needs analysis logged 
into the online learning platform (or portal, etc.) and performed a live 
demonstration of these tools. 

• Learner tasks while using these tools. For example, we explained the extent and the 
frequency in which they would have to participate at the on-line sessions, use the 
forum, do some exercises, and so on. 

• The duration of the e-courses, the description of educational activities at a high 
level, and the various roles. 


Outputs of the Analysis Phase: The Revit Learning Goals 


From the learning needs analysis emerged that the first educational goal would be to 
provide the level of digital literacy required to use the Revit learning tools and services 
effectively. It was expected that the learners wouldn’t have a good ICT background 
which was confirmed from the learner analysis. To remediate for this, the e-course 
“Introduction to Web Technologies” was the first to be designed and offered to all the 
perspective learners. Of a value by itself, this course helped reduce the learners’ 
cognitive barriers related to the lack of ICT-competence. The learning needs analyses 
conducted by five coordinated teams in the five remote areas converged into another to 
e-courses. For each e-course, the learning objectives reflected the competencies needed 
from the learners’ standpoint and were clearly stated in terms of knowledge, skills, and 
attitudes. For instance, in the “EFL Teachers using Web Technologies” the main 
educational aim was training EFL teachers to make successful lesson plans. The 
learning objectives were explicitly stated as follows: 

• Knowledge-oriented: trainees acquire new knowledge on lesson planning 
methods by reading articles, listening to lectures, etc. 

• Skills-oriented: trainees tailor lesson planning models to meet their own 
teaching needs; ability to work together in a professional inter-european 
context; exchange of problems and concerns with fellow practitioners. 

• Attitudes-oriented: trainees appreciate the importance of lesson planning (self- 
assessment, course improvement, data-gathering/exchanging, etc.). 
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The Revit methodology for needs analysis of trainees proved to be well adapted and 
efficient, as judged a posteriori by the participants (see Table 1 and Table 2). The 
contacts with the locals have led to an authentic investigation of the local culture and 
the important points in the life of eventual participants. For instance, in Ios island 
(Greece) the time of the arrival of the boats (with tourists) was very important for the 
local economy and life and, indirectly, affected the synchronous courses. In most cases, 
the course topics were important for the professional and personal life of learners (see 
Table 3). Also, the initial assumption that the learners wouldn’t have clear ideas on how 
ICT would help them in their professional development was confirmed by the learning 
needs analysis, as well as that the learners living in the same remote area would strongly 
affect each other’s opinion about the value of the program. The latter information was 
provided by the local moderator who liaised between the project team in each 
application area and the locals and who was in constant contact with both sides (via 
physical meetings with locals and via computer mediated communication with the 
project team). 

Table 1 

Quality of the E-Courses 


The distance courses of REVIT were satisfactory and helped you to achieve 

your personal goals 

Answer 

Count 

Percentage 

Completely disagree 

(1) 

1 

0.76% 

(2) 

2 

1.52% 

(3) 

12 

9.09% 

(4) 

17 

12.88% 

Completely agree (5) 

70 

53.03% 

No answer 

4 

3.03% 

Non completed 

26 

19.70% 


|Vol 14 | N05 


Dec/13 


223 
















Learning Needs Analysis of Collaborative E-Classes in Semi-Formal Settings : The REVIT Example 


Mavroudi and Hadzilacos 


Table 2 

Difficulty of the E-Courses 


The distance courses of REVIT were rather hard to follow 

Answer 

Count 

Percentage 

Completely disagree 

(1) 

43 

32.53% 

(2) 

17 

12.88% 

(3) 

21 

15.91% 

(4) 

14 

10.61% 

Completely agree (5) 

6 

4.55% 

No answer 

5 

3.79% 

Non completed 

26 

19.70% 


Table 3 

Impact of the E-Courses on the Trainees’ Professional Life 


The REVIT e-courses will help you in your job or you future professional 

plans 

Answer 

Count 

Percentage 

Completely disagree (1) 

2 

1.52% 

(2) 

6 

4.55% 

(3) 

16 

12.12% 

(4) 

16 

12.12% 

Completely agree (5) 

59 

44.70% 

No answer 

1 

0.76% 

Non completed 

32 

24.24% 


The questionnaires, addressed to trainees via an online survey component that was 
integrated in the Revit DL platform, were answered by 136 people in total (80% of the 
total number of participants). The repartition of the answers to the countries is 24% 
from Bulgaria, 17% from Cyprus, 18% from Finland, 17% from Greece, and 24% from 
Poland. 
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How Results Impact Theory and Practice 


Bridging Theory and Practice 

A variety of interviewing and questioning techniques were used in the analysis process 
in order to provide a contextualized approach that would harness socio-cultural 
diversity and foster the elicitation of actual learning needs, while also studying previous 
work concerning lifelong learning (LLL) best practices in rural areas derived from 
previous projects. The Revit team mainly examined projects that targeted the adoption 
of innovative techniques and entrepreneurship by adult professionals. Examples 
include: training initiatives of the Chambers of Commerce in Italy 1 , Ecologica 2 3 (online 
learning for organic farming), and others. Moreover, the team built on the experiences 
gained by the MustLearnIT projects, a venture also acknowledged as a “best practice in 
social inclusion” aimed to provide learning opportunities for children in remote rural 
communities in a way that included their teachers and the community as a whole. The 
impact of the MustLearnIT project has both inspired and triggered the Revit project 
and the experiences gained by the former provided valuable insights on various aspects 
of the latter, like how to adapt the Revit distance learning methodology to the context of 
school education (one of the Revit e-courses was addressed only to pupils). 

The flexibility in the needs analysis meant that various techniques were used in the 
participating countries. For example in Cyprus analysis of national statistical data 
concerning barriers in the uptake of LLL by adults living in remote areas clearly showed 
that the main reason for not participating in formal or informal LLL activities was lack 
of time due to family duties (41.4% in rural areas) followed by the fact that the training 
program was not compatible with the job time schedule (30.2% in rural areas). 

On the other hand, in order for the Revit project partners to follow similar 
methodological approaches as far as needs analysis was concerned, specific guidelines 
were formed early in the project indicating the most appropriate methods for examining 
educational needs of schools located in small, remote villages. Thus, the partners had to 
select one or more of the following methods: 

• observation, 

• estimation, 

• document analysis, 

• survey, 

• dialogue. 


1 http://www.chamberofcommerce.it/inglese/formare-.asp 

2 http://www.ecologica.net/website/ 

3 http://mustlearnit.cti.gr/ 
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An example: If prospective learners already had internet access and were digitally 
literate, then an online questionnaire would be more appropriate. With the use of these 
methods each partner country that participated in implementing courses in the Revit 
project provided a study on 

• the selected target groups in the remote communities it addresses; 

• the identified educational requirements of these groups it addresses; 

• the adaptations to the DL models/schemes, platform(s), and ICT based tools 
that were made to accommodate the previous two points and other local 
conditions. 

Dealing with Constraints and Obstacles 

The project managed to reach the outcomes described below under tight timetables and 
economic constraints agreed before the start of the project with the funding agency. 
Revit was considered a best practice in the field of social inclusion (U. Halier-Block, 
personal communication, 22 May, 2012) by its funding agency, the Education, 
Audiovisual & Culture Executive Agency of the European Commission (EACEA). The 
development of a learner-centered curriculum and the provision of the e-courses was 
one of the main priorities agreed between the funding agency and the Revit research 
team. This gave the team the opportunity to conduct the extensive analysis described in 
this paper, speaking in economic terms (i.e., budget allocated for this purpose). The 
economic feasibility of the educational venture was achieved mostly by keeping low 
costs for the design, development, and implementation of the e-courses, while keeping 
high quality outcomes in each of these phases. Rapid prototyping has helped towards 
this direction and also the fact that in this particular e-learning project the duration of 
the e-course was at most three months. The subject matter experts were called to create 
the e-courses at a low cost, a ‘light’ version of the course material that was 
easier (since the course was addressed to beginners) and limited (since the course had 
limited duration) compared to the materials that they were using in their everyday 
teaching practices. The subject matter experts in some cases could also play the role of 
the e-tutor, depending on their availability and competencies. This also illustrates the 
principle of separation between the development and the implementation of the e- 
courses that was adopted from the start of the project. 

Concerning the needs analysis, it is not very clear how local conditions could be 
determined precisely in all cases: discussions with as many as possible people of the 
target area, knowledge of the infrastructure, and the explanation of all mutual duties 
and obligations; all these elements seem to be necessary. However, it is true that this 
thorough needs analysis is difficult and may be too expensive for a large scale 
application. In a small community it is easier to contact eventual participants and to 
determine their needs with accuracy, while in larger areas it is more difficult. In this 
case, a balance should be established. 
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A significant number of drop-outs was observed (42 out of 212 adults that originally 
participated in the program). Even if, in general, a large percentage of drop-outs is 
expected in distance courses (Tyler-Smith, 2006; Wang et al., 2004) this still remains 
an important open question. Lack of time was an important factor for these dropouts, as 
the evaluation results revealed. Also, learners reported that the difficulty level of the 
learning activities was sometimes too challenging and other times too easy for them; or 
that the heterogeneity of the learners’ backgrounds made it impossible to balance 
interest and learning. Other examples relate to course length and computer availability: 
Even if the course length was appropriate for some, it certainly was not so for 
everybody; a computer at home does not guarantee ready access at convenient times. 
On the other hand, only a very large scale project which could vary these parameters in 
distinctively different ways and provide personalized instruction could give proper 
answers. It would also be interesting to revisit the areas a few years later and gauge (a) 
how learning has progressed over time and its impact on the participants’ professional 
lives (i.e., what learning has been retained and put to use) and (b) what the opinions of 
learners, drop outs, and non-participants are, in retrospect, about the value of the 
endeavor as an educational program. Finally, although the analysis resulted in topics 
that had an impact on the trainees’ professional and personal lives, it should be noted 
that this detailed analysis was a factor for a considerable increase of the total cost. 


Which of the Revit Conclusions can be Generalized? 


The know-how gained from the design and the implementation of the project can be 
capitalized as a “model” (or at least as elements of a model) for future projects or 
courses that could be organized under similar circumstances. This project is different 
from the usual distance learning courses (and that is the point where new, important 
know-how is gained) in that courses were not created in abstracto for some virtual 
community of users/learners, but were designed and constructed specifically for people 
living in these remote areas with educational needs defined through a thorough 
examination. 

Although the e-courses were well-prepared, in some cases contradictory estimations 
from participants emerged. This phenomenon (contradictory statements) was observed 
for instance in the case of their preference for printed learning material, as opposed to 
digital learning material. Previous research (Moore & Kearsley, 2005, pp. 91-92) has 
actually confirmed the Revit experience, that is, some learners prefer printed materials, 
giving reasons of reliability, portability, and habit. This put forth the pedagogical 
requirement of having the learning material available in various formats (including in 
printed form) and then letting the learners choose the most appropriate for them. 

The participants (learners) in the e-courses represented a set of people with diverse 
characteristics (age, sex, profession, level of education, country) which is an indirect 
indicator of the reproducibility of the findings. Also, the components of each course 
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were defined independently from the content, which was provided by experts of the 
field, and adapted to the standard forms of the e-courses, ready to be delivered at a 
distance. Finally a third person, a teacher or a local moderator, was responsible for the 
delivery of the course (the “teaching”). The separation of the form and the content may 
seem unusual, since in typical lessons the same person prepares the courses (form and 
content) and also delivers them (i.e., teaches). But the Revit method produced models 
of reusable courses which have low cost and can be easily tested with several criteria 
(efficiency, conformity to a set of standards, etc.). These courses were often “re¬ 
localized”, that is adapted to local conditions (language, etc.) outside the borders of the 
country of their initial production, overcoming cultural and language barriers. It is 
worth noting that the process of localization of the didactic material was not a trivial 
one: It went far beyond a simple translation; it was an adaptation in the sense of 
transformation to the local culture and this was a demanding process. 

It is clear, on the other hand, that the Revit’s learners, living in remote areas, have 
particular sociocultural characteristics, affecting the success of a distant course, such as 
practicing traditional professions, and having a strong emotional “connection” to the 
members of their local community. The local communities were mobilized and affected 
positively by the Revit educational venture. The participants’ dispositions seem to be 
the best assurance for the continuation and the extension of these courses - finally for 
the idea of lifelong learning. These side effects cannot be easily measured. However, the 
trainees, almost unanimously, declared that they prefer courses organized in groups and 
they also expressed clearly their preference for a specific group size: 3-5 persons. They 
had the feeling of belonging in a small class where it is easy to collaborate with each 
other, without being divided into sub-groups. 

The E-Course Settings and their Enactment 

In order to provide some insights on the important aspect of the interactivity of the 
distance courses, a sample of five e-courses was selected randomly and examined. In 
particular, overall course design documents and specific lesson plans (usually 8-11 
lesson plans per course) were analyzed. The evaluation rubric proposed by Roblyer and 
Wiencke (2003) in their seminal work titled “Design and Use of a Rubric to Assess and 
Encourage Interactive Qualities in Distance Courses” was used. It consists of a scale of 
interaction which ranges from low to high in conjunction with five interactivity 
dimensions: social (rapport-building), instructional, technological, learner driven, and 
instructor driven. The results can be summarized as follows (a four-point scale is used 
where the value 1 is assigned to low interactivity and the value 4 to high interactivity ): 

• Concerning the social aspect, all the courses have a score equal to 3, since “in 
addition to providing exchanges of personal information among learners, the 
instructor provided at least one other in-class activity designed to increase 
communication and social rapport among students”. 
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• Concerning the instructional aspect, four courses have a score equal to 4 (“in 
addition to requiring learners to communicate with the instructor, instructional 
activities require learners to develop products by working together 
cooperatively and sharing feedback”) whereas one course has a score equal to 3 
(“in addition to requiring learners to communicate with the instructor, 
instructional activities require learners to communicate with one another”). 

• Concerning the interactivity of technology resources, all the courses have a 
score equal to 4 (“in addition to technologies used for two-way synchronous and 
asynchronous exchanges of written information, additional technologies, e.g., 
teleconferencing, allow one-way visual and two-way voice communications 
between instructor and learners”). 

• Concerning the learner engagement and the instructor engagement, there is not 
enough evidence derived from the document analysis to decide upon these 
aspects. 

Finally, concerning the cost-effectiveness of the e-course design and development, it 
was enhanced by various parameters that can be summarized as follows: 

• the adoption of e-learning standards (such as the SCORM4 technical standard 
for course packaging and the LOMs metadata application profile schema for 
course description); 

• the adoption of open source or freeware solutions (such as the eXe XHTML 
authoring tool 4 5 6 7 , the Moodle course management system?, the OpenSim virtual 
world 8 and, finally, Web 2.0 tools. It should be noted here that the Elluminate 
webconference™ platform, which is a commercial solution, was hosted by one 
of the project partners and was used by project stakeholders at no extra cost); 

• the collaborative design and subsequent extensive use of templates (course 
design template and lesson design template in a word format and template 
scenario for the development of the Revit lessons in an eXe XHTML editor 
compliant format) and, finally; 

• a set of guidelines and other supportive information for authoring and 
localizing a Revit e-course. 

The above choices not only minimized effort and cost, but also had a positive impact on 
the re-usability and the ease of localization of the e-courses. Methodologically speaking, 
after the completion of the analysis phase, the development of the course syllabus, and 
the ensuing lesson plans, learning activities and resources followed as a computer 

4 Sharable Content Object Reference Model (SCORM) 

5 Learning object Metadata (LOM) 

6 eLearning XHTML editor, http: //exelearning.org/ 

7 Moodle CMS, https://moodle.org/ 

8 OpenSimulator, http: //opensimulator.org 
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supported collaborative design process between the partners that had an interest in the 
specific e-course. Having a European perspective in the selection of the activities and 
the resources by keeping a balance between local needs, while having a European 
audience in mind, was a focal requirement for the sake of an easier re-localisation of the 
e-course. 

Note: The analysis framework presented in this paper adheres to a balanced approach 
between local choices with a pan-European perspective and instructional design theory 
with practice, while keeping a certain flexibility level in the pathways taken during the 
analysis in each application area and also utilizing the facilities of the schools. 
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Appendix A 


Sample of the Diagnostic Questionnaires 

The online survey questionnaire (used in the Fornetka application area) was 

comprised of the following questions: 

• Demographics (age, sex, field of working) 

• Educational context (Readiness to participate in distance E-course in Primary 
School in Fornetka, Areas of interest concerning the distance E-course, I have the 
following ICT skills) 

• ICT facilities (I have the following Internet connection at my home) 

The questionnaire handed out to the learners in Kula (BG) in a written format 

contained the following fields: 

• Demographics (Sex, age, occupation) 

• Prior knowledge (What are your computer skills?) 

• Willingness/Readiness (Would you be interested to attend e-courses at High school 
“Vasil Levski” in Kula?, If your answer to the previous question is “no”, would you 
attend e-courses from your home/work?) 

• Interests/aspirations (What ICT skills are you interested in developing?, Which of 
the following topics of potential e-courses interests you most?, Would you be willing 
to participate in an e-course with fellow trainees from different age groups?) 
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Appendix B 


Methodology Description in a Country Level 

This section presents the needs elicitation methodology (method, instruments, 
protocols, participants/ respondents) in a country level. 

A. Ullava, Finland 
Method: online questionnaire 

Protocol: The questionnaire was send via the teachers, at first to all the parents of the 
pupils in Veikko Vionoja and Rahkonen school. It was not possible to send the 
questionnaire to all the adults in the application area and this sample was chosen to 
present the needs of adults in Ullava. Teachers had in their disposal the email addresses 
of the parents. The data was collected electronically by SPPS/Mr. Interview software. 

Instrument: online survey tool with 12 questions, 10 closed, multiple choice questions 
and 2 open-ended questions at the end of the questionnaire so that participants could 
elaborate about their interests and needs towards distance E-learning and 
videoconference based learning. The first 7 questions of the questionnaire are identical 
with the ones in the questionnaire that was administered in Fornetka, Poland (see 
previous section) i.e. demographics (3 questions), educational context (3 question) and 
ICT facilities (1 question). 

Respondents: 27 persons completed the questionnaire successfully. 

B. Fornetka, Poland 

Method/Protocol: Physical meetings and discussions with the community of Fornetka, 
including the local people, the authorities and the local co-ordinator. The aim of the first 
meeting (semi-public) was to inform the community about the project and anticipate 
their interest to participate as the application area in Poland. The second meeting was 
organized with the perspective learners in order to investigate their needs. The third 
meeting was public with invited representatives of local authorities. A fourth public 
meeting was held at Fornetka, in order to finalize the list of the educational needs and 
get the commitment of the people that would participate in each course. 

Instrument: Between the second and the third meeting an online questionnaire was 
administered to the perspective learners (see Appendix A). 

Respondents: 40 persons completed the questionnaire successfully. 

C. Kula, Bulgaria 

Method/protocol: The local project team together with the local moderator in Kula after 
having conducted questioning (using the online questionnaire) and interviewing (focus 
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groups) during their visits in the area, identified the educational needs of the potential 
beneficiaries. A follow-up public meeting was scheduled for getting commitment from 
the participants in the e-courses. From the questioning, discussions and meetings 
conducted the educational needs were finally specified. 

Instrument: A short questionnaire with to questions was disseminated among potential 
local beneficiaries (see Appendix A). 

Respondents: 21 questionnaires were successfully filled in and returned to the local 
moderator in Kula. 

D. Koufonissi and Ios islands, Greece 

Method/protocol: a two-staged method was adopted, that is, Stage 1) interviews with 
local people and reports from local teachers, Stage 2) observation and dialogue methods 
(visits to both islands, organization of infodays and parallel collection of data needed). 
Also, contacts with the school directors (early in Stage 1) were established. 

Instrument: Attending members of the local community in each island were requested 
to complete a questionnaire in order to determine the learners’ profiles. The learner 
profile questionnaire contained personal profiling information, educational and 
professional background, computer literacy information and further learning interests. 

Respondents/participants: 129 preferences on a list of potential Revit e-courses (but 
this number does not indicate the exact number of participants, since several persons 
expressed interest in more than one course). 

E. Palaichori, Cyprus 

Method/protocol: Members of the project team visited the community of Palaichori four 
times, in order to specify the educational needs of the locals. The aim of the first 
meeting was to inform the community about the project and anticipate their interest to 
participate as the application area in Cyprus. During the second and the third visits, 
meetings with perspective learners were organized and the methods of discussion and 
brainstorming were used in order to elicit their educational needs. Also, the team used 
the school infrastructure and equipment (internet connection, projector, speakers) in 
order to demonstrate the main components of the Revit distance learning system, its 
tools and services. In the last meeting in Palaichori, the list of the educational needs 
was finalized, consensus was reached and the project team gained the learners’ 
commitment in the courses. 

Instrument: A brainstorming protocol was used with notes taking from a member of the 
research team, in parallel. 
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Participants: 40 preferences on a list of potential Revit e-courses (but this number does 
not indicate the exact number of participants, since several persons expressed interest 
in more than one course). 
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